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Micro  UAV  Path  Planning  for  Reconnaissance  in  Wind 

Nicola  Ceccarelli,  John  J.  Enright,  Emilio  Erazzoli,  Steven  J.  Rasmussen  and  Corey  J.  Schumacher 


Abstract —  The  problem  addressed  in  this  paper  is  the  control 
of  a  Micro  Unmanned  Aerial  Vehicle  (MAV)  for  the  purpose 
of  obtaining  video  footage  of  a  set  of  known  ground  targets 
with  preferred  azimuthal  viewing  angles,  using  fixed  onboard 
cameras.  Control  is  exercised  only  through  the  selection  of 
waypoints,  without  modification  of  the  MAV’s  pre-existing 
autopilot  and  waypoint  following  capability.  Specifically,  we 
investigate  problems  and  potential  solutions  of  performing  this 
task  in  the  presence  of  a  known  constant  wind.  Simulations 
are  provided  in  presence  of  randomly  perturbed  wind,  based 
on  the  Air  Force  Research  Laboratory  equipment  and  the  high 
fidelity  simulator  MultilJiF2. 

I.  Introduction 

The  problem  addressed  in  this  paper  is  the  control  of  a 
Micro  Unmanned  Aerial  Vehicle  (MAV)  for  the  purpose  of 
obtaining  video  footage  of  a  set  of  known  ground  targets 
with  preferred  azimuthal  viewing  angles,  using  onboard  body 
frame  fixed  cameras.  Control  is  exercised  only  through  the 
selection  of  waypoints,  without  modification  of  the  pre¬ 
existing  autopilot  and  waypoint  following  capability.  Specif¬ 
ically,  we  investigate  problems  and  potential  solutions  of 
performing  this  task  in  the  presence  of  a  known  constant 
wind  field. 

Algorithms  for  flight  path  guidance  and  synchronous  target 
observations  have  been  developed  in  several  works  [3], 
[19],  [17],  [18],  [15].  In  particular  in  [17],  [18],  [15]  the 
wind  scenario  has  been  explicitly  taken  into  account  by 
developing  control  laws  based  on  actuated  cameras.  The  path 
planner  we  develop  generates  a  waypoint  sequence  with  the 
primary  objective  of  giving  rise  to  a  trajectory  such  that 
each  target  is  viewed  by  one  of  the  onboard  cameras  from 
the  preferred  viewing  angle.  As  a  secondary  priority,  the 
path  planner  should  minimize  the  total  flight  time  of  the 
resulting  trajectory  in  order  that  intelligence  is  gathered  in 
a  timely  manner.  Moreover  it  is  our  aim  to  design  a  path 
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planner  which  reflects  the  underlying  behavior  of  the  onboard 
autopilot,  allowing  for  easy  path  following,  especially  in 
consideration  of  the  known  wind  field  [13]. 

This  work  is  motivated  by  the  ongoing  research  at  the  Air 
Force  Research  Laboratory  (AFRL)  [5]  on  flight  operations 
with  MAVs.  The  limitation  that  path  planning  must  be  done 
through  a  sequence  of  waypoints  alone  is  not  a  simplification 
of  the  problem,  but  rather  a  requirement  to  be  met  due  to 
the  current  testbed.  This  approach  should  be  considered  an 
alternative  to  methods  for  minimum  time  path  generation  in 
wind  where  the  trajectories  are  provided  in  terms  of  pose 
time  profiles  [9], [10]. 

Although  we  assume  a  known  constant  wind  field,  we  aim 
to  design  a  path  planner  robust  to  variations  in  the  wind  field. 
Our  objective  is  to  provide  reliable  quality  of  service  to  the 
end  users  of  the  MAVs.  The  quality  of  the  video  provided 
can  be  measured  with  several  metrics  including 

•  duration  the  target  is  within  the  camera  footprint, 

•  distance  from  center  of  camera  footprint, 

•  difference  between  actual  and  preferred  viewing  angle. 
Moreover,  the  robustness  of  the  path  planner  can  be  measured 
by  the  rate  at  which  targets  are  missed. 

In  the  following  sections  we  develop  our  path  planner  in 
a  step-by-step  manner,  beginning  with  the  local  geometry  of 
a  single  target  and  the  MAV,  continuing  with  the  method  of 
moving  from  one  target  to  the  next,  and  ending  with  methods 
for  choosing  the  overall  order  of  targets  in  the  construction 
of  the  tour. 

II.  Assumptions  and  Problem  Statement 

We  assume  that  the  autopilot  follows  a  line  segment 
by  “crabbing”,  i.e.,  maintaining  level  wings,  but  a  heading 
different  than  the  ground  track.  The  MAV  could  fiy  with 
non-zero  bank  and  sideslip  angles,  with  heading  equal  to 
the  ground  track.  However,  for  small  fixed  wing  UAVs,  the 
autopilot  is  usually  designed  with  two  independent  longitu¬ 
dinal  and  lateral  controllers  [1],  preventing  the  possibility 
mentioned  above.  It  is  also  possible  that  the  pitch  of  the 
aircraft  is  non-zero,  as  the  angle  of  attack  may  depend  on 
airspeed.  However,  since  we  command  a  constant  airspeed 
throughout  the  mission,  the  steady- state  pitch  can  be  eval¬ 
uated  a  priori,  and  thus  the  change  in  geometry  between 
the  MAV’s  position  and  heading,  and  the  camera  footprints 
position,  can  be  easily  built  into  the  planner.  Moreover,  our 
observation  of  the  real  MAVs  behavior  suggests  that  all  of 
these  factors  are  in  fact  negligible. 

Formally,  we  state  our  problem  as  follows.  Given  n 
targets  {ti,  r2, . . . ,  r^}  each  defined  by  a  unique  position 
and  viewing  angle, 

n  =  {xi,yi,0i)  (i=l...n), 


1 


plan  a  finite  sequence  of  waypoints  X  =  {Xi,  X2, . . . ,  X^} 
defined  by  positions, 

Xj  =  {xj,yj)  {j  =  l...N) 

and  sequence  order  in  increasing  j  beginning  at  j  =  1,  such 
that  the  resulting  trajectory  of  the  MAV  allows  reconnais¬ 
sance  of  each  of  the  n  targets  at  its  preferred  viewing  angle 
Oi,  with  one  of  the  available  onboard  cameras. 


III.  Geometric  Considerations 


In  this  section,  we  address  the  following  problem.  Given 
a  target  with  fixed  position  and  preferred  azimuthal  viewing 
angle,  r  =  how  do  we  plan  a  path  such  that 

the  may’s  camera  will  view  the  target  at  the  correct  angle? 

To  get  the  highest  quality  picture  possible,  we  attempt 
to  place  the  center  of  the  footprint  directly  on  the  target, 
rather  than  simply  requiring  the  target  to  be  inside  the 
footprint.  In  steady  level  flight,  the  distance  in  the  horizontal 
plane  between  the  MAV  and  the  center  of  the  footprint  is 
d  =  :r — ^ — ,  where  h  is  the  altitude  of  the  MAV  and  (/)cam 

tan  (pca,m 

is  the  depression  angle  of  the  camera,  i.e.,  the  polar  angle 
measured  down  from  the  horizontal  plane  at  the  MAV’s 
altitude.  Thus,  at  the  time  of  video  capture,  the  MAV  must  be 
a  distance  d,  in  the  horizontal  plane,  from  the  target.  In  order 
to  view  the  target  at  the  correct  angle,  the  relative  angular 
position  of  MAV  to  the  target  must  be  Ot-  Combining  these 
facts,  the  video  capture  must  take  place  at  a  location: 


^cap 

Xt  ^  d  COS  Ot 

^cap 

Ht  d  sin  Ot 

Denote  Oh  as  the  aircraft  heading  and  ^cam  as  the  relative 
azimuthal  angle  of  the  camera  measured  from  the  nose  of 
the  aircraft,  we  know  that  the  line  of  sight  of  the  camera 
is  6>los  =  Oh  ^  Ocam-  We  set  our  desired  line  of  sight  as 
^LOS  =  6>t  +  tt  in  order  to  look  toward  the  target  from  a 
relative  angular  position  Ot-  Combining  we  find  our  desired 
heading.  Oh  =  Ot  -  6>cam. 

The  question  remains:  given  a  constant  wind  field,  how  do 
we  choose  a  ground  track,  i.e.,  pair  of  waypoints,  such  that 
the  resulting  heading  will  be  the  desired  one?  Assuming  a 
constant  wind  speed,  wind  direction,  and  vehicle  air  speed, 
vw,  Ow,  and  Va,  and  considering  that  in  steady  level  flight, 
the  air  velocity  direction  is  aligned  to  the  heading  of  the 
aircraft,  the  ground  velocity  is  the  resultant  of  the  air  velocity 
and  wind  velocity 


Va  COS  Oh  cos  0\Y 
Va  sin  Oh  vw  sin  Ow 


Hence,  by  denoting  with  Z  :  ^  [— tt,  tt]  the  vector  phase, 

we  obtain  the  desired  ground  track  direction  as 
Og  =  IV  g. 

Thus,  we  choose  a  pair  of  waypoints  such  that  the  line 
between  them  intersects  the  point  (xcap^Vcap)^  and  has  a 
direction  of  Og. 

In  the  equipment  and  simulations  considered,  there  is  a 
front  camera,  for  which  6>cam  =  0,  and  a  left-side  camera, 
for  which  6>cam  =  7r/2.  Thus,  as  shown  in  Figures  1(a)  and 


jO 


Fig.  1.  Schematic  for  waypoint  for  different  choice  to  view  the  target. 


1(b),  the  MAV  may  use  either  the  “front”  or  “left”  camera  to 
view  a  given  target,  and  each  of  these  choices  corresponds  to 
its  own  ordered  waypoint  pair  that  the  MAV  must  fly.  Our 
problem  is  now  defined  by  a  set  of  waypoint  pairs.  Each 
waypoint  pair  corresponds  to  the  reconnaissance  of  a  specific 
target,  each  with  a  pre-defined  choice  of  cameras. 

In  Section  IV,  we  begin  with  two  targets,  i.e.,  each  target 
simply  corresponds  to  a  single  ordered  pair  of  waypoints. 
Given  these  two  waypoint  pairs,  we  develop  a  path  planner 
that  places  waypoints  connecting  the  two  pairs. 

IV.  Path  Planner 

In  this  section  we  tackle  the  problem  of  finding  a  feasible 
path  for  visiting  two  subsequent  targets,  each  with  their  own 
preferred  viewing  angle.  First  we  develop  the  structure  of 
our  planner  without  considering  wind,  and  then  show  how 
the  planner  adapts  to  a  known  constant  wind  field. 
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The  inner-loop  of  the  autopilot  controller  works  by  fol¬ 
lowing  the  line  segment  between  sequential  waypoints.  Each 
time  the  MAV  reaches  a  waypoint,  it  begins  to  follow  the 
next  line  segment,  and  exhibits  some  transient  behavior 
characterized  by  a  damped  oscillation  that  decays  to  the 
desired  steady  state  flight  along  the  new  line.  In  some  cases, 
the  line  segment  may  not  be  sufficiently  long  for  the  MAV 
to  reach  steady  state,  or  the  change  in  desired  heading  is 
too  drastic,  and  the  MAV  may  miss  the  next  waypoint. 
Rather  than  relying  on  this  transient  response  in  our  path 
planning,  we  attempt  to  choose  waypoints  in  such  a  way 
that,  upon  reaching  each  waypoint,  the  MAV  has  reached 
steady  state  flight  along  the  previous  line  segment.  This  is 
done  by  placing  an  upper  bound  on  the  heading  difference 
between  sequential  line  segments,  and  a  lower  bound  on  line 
segment  length. 

As  shown  previously,  finding  a  feasible  path  between 
targets  corresponds  to  finding  a  path  connecting  two  pairs 
of  waypoints.  Given  an  initial  and  a  final  pair  of  waypoints, 

-^init  —  [-^initi  9 -^init2  ]  -^final  —  [-^finali  9 -^final2  ]  9 


find  a  number  of  steps  N  e  N,  and  an  input  sequence 
u  =  [?i(l) . . .  u{N  —  1)]  such  that 


X{k  +  l) 

=  X{k)+u{k) 

s.t. 

X(0) 

—  2finiti 

X(l) 

X{N  -1) 

X{N) 

—  2fgnal2  • 

Once  a  path  has  been  found. 

{k  =  l...N  -1) 


(1) 


loop  will  be  responsible  for  flying  it,  based  on  the  sequence, 
X{k),  of  waypoints.  Hence,  we  introduce  additional  con¬ 
straints  in  order  that  the  resulting  path  may  be  followed  by 
the  autopilot  easily.  Specifically,  we  wish  to  minimize  the 
transient  response  to  direction  change  in  terms  of  settling 
time  and  peak  error  between  the  actual  trajectory  and  the 
desired  path.  In  Fig. 2,  possible  transient  responses  of  the 
MAV  for  different  changes  of  direction  are  depicted.  In 
particular  let  us  define 


0{k)  =  {Zu{k)  —  ^u{k  —  1))  mod  tt 


(2) 


as  the  change  in  direction  performed  at  the  step  k.  We 
introduce  the  angular  constraints 

\e{k)\<a  {k  =  2...N-l),  (3) 


where  a  is  the  maximum  magnitude  allowed  of  the  change  in 
direction  at  each  step  of  the  waypoint  path.  This  constraint 
is  meant  to  keep  the  peak  error  within  a  reasonable  level. 
Furthermore,  we  introduce  a  requirement  on  the  minimum 
length  of  each  step.  This  is  designed  to  allow  the  MAV  to 
reach  steady-level  flight  before  the  next  change  in  direction 
occurs: 


||^(A:)||>L  {k  =  l...N-l).  (4) 


Fig.  2.  Transient  response  due  to  direction  changes. 


In  many  ways,  the  building  blocks  of  our  path  planner  are 
line  segments,  not  waypoints. 

We  search  for  a  minimum  length  path,  feasible  with 
respect  to  system  (1)  and  for  which  constraints  (3)  and 
(4)  hold.  Taking  inspiration  from  work  on  Dubins  vehicle 
[8], [2],  we  restrict  the  search  to  the  following  class  of  control 
sequences: 

lA  G  ['U-init  2init  ^  'i^final]9  (^) 

where  T^nit  9  2finai  ^  2^  represent  input  sequences  performing 
a  right  or  left  turn  at  the  maximum  rotational  rate,  i.e., 
constraint  (3)  is  saturated;  and  C  represents  the  connecting 
step  between  the  initial  and  final  turn.  In  particular  we  define 


'^final  ~  2ffinal2  9 

r  =  {[ur...ur]e 

cos  (ax) 


(6) 

(7) 


ux  =  L  ' 


sin{ax) 


,  ar  G  {a,  (8) 


C  =  gM^  :  ll^ll  >  T  V  ll^ll  =  0}. 


(9) 


Although  the  issue  of  the  existence  of  such  a  path  for 
any  two  pairs  of  waypoints  has  been  neglected,  we  should 
report  that  counterexamples  can  be  generated  by  choosing 
arbitrarily  close  initial  and  final  waypoint  pairs.  Simulations 
have  shown  this  event  to  be  rare,  and  when  it  does  occur, 
it  simply  means  that  the  tour  designer  does  not  consider 
the  possibility  of  placing  those  two  pairs  of  waypoints  in 
sequence. 

The  above  formulation  does  not  consider  the  heavy  effect 
of  a  wind  field  on  the  flight  performance  of  the  MAV.  Con¬ 
straints  (3)  and  (4)  correspond  to  performance  requirements 
in  a  zero  wind  field,  based  on  the  transient  response  of  the 
MAV  controlled  by  the  autopilot.  It  is  possible  to  transform 
the  path  planning  problem  in  the  presence  of  a  known  con¬ 
stant  wind,  to  one  with  zero  wind,  by  considering  a  moving 
target,  with  velocity  opposite  to  the  actual  wind  velocity 
[9].  In  order  to  maintain  consistency  with  the  original  path 
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planning  problem,  initial  and  final  constraints  on  (1)  must  be 
generated  as  follows 


X(0) 

(10) 

V(l) 

—  ^init2  ■ 

=  -^inits  ~  ^2  •  Vw 

(11) 

X(V-  1) 

=  -^finali  —  ^AT-l  *  Vw 

(12) 

X{N) 

=  -^finaU  ~  •  Vw , 

(13) 

where  Vw  is  the  wind  velocity  vector,  while  Tk  is  the  time 
required  to  arrive  at  the  k-th  waypoint.  It  should  be  noted  that 
the  value  of  depends  on  the  particular  path  considered  and 
its  computation  require  the  solution  of  a  quadratic  equation. 

Now  we  look  for  an  input  sequence  u*  e  U  that  gives 
the  minimum  time  path.  In  practice  we  bound  the  maximum 
number  of  subsequent  turn  steps  of  (8)  to  Nr  <  [^1’ 
we  consider  the  shortest  among  the  resulting  feasible  paths. 
Once  u*  and  the  associated  path  X*  have  been  determined, 
we  transform  back  to  the  constant  wind  fixed  target  scenario 
by  considering  the  control  input  sequence  u*: 


Fig.  3.  Transformation  of  inputs  from  no  wind  moving  target  scenario 
(u{k))  to  wind  fixed  target  scenario  (u(k))  and  associated  transient  response 


u*ik)=u*{k)  +  r,(^k)-Vw  V(fc  =  l...Ar-l),  (14) 


where,  by  denoting  with  Va  the  MAV  air  speed, 


^  U* (k) 


(15) 


is  the  time  to  execute  step  u*{k),  assuming  perfect  path 
following.  Using  (10)-(13)  it  is  trivial  to  show  that  u*  is 
feasible  w.r.t.  (1).  Moreover,  by  (15),  the  tour  time  T  = 
T^*(/c),  to  execute  the  path  X*  generated  by  u*,  is 
exactly  the  same  time  required  to  accomplish  the  associated 
path  X*  in  the  scenario  of  a  moving  target  and  null  wind; 
this  property  holds  in  general  for  any  path  generated  in  the 
moving  target  scenario  and  transformed  to  the  wind  scenario 
by  (14).  Hence  it  follows  that  X*  is  of  minimum  time  among 
the  paths  generated  according  to  (5),  in  the  scenario  of  zero 
wind  and  moving  target,  and  transformed  by  (14). 

In  Fig. 3  the  effect  of  transformation  (15)  is  depicted.  Note 
that  that  while  turning  against  the  wind  results  in  a  shorter 
step  and  a  more  gentle  turn  w.r.t.  the  original  input  u*{k), 
turning  with  the  wind  results  in  a  longer  step  and  a  sharper 
turn.  This  effect  accommodates  the  transient  response  of 
the  MAV  in  wind  (solid  blue  line).  This  behavior  is  less 
damped  when  turning  with  the  direction  of  the  wind,  and 
when  turning  against  wind,  it  exhibits  a  a  highly  damped 
response,  allowing  the  next  step  to  take  effect  sooner. 

In  Fig.4  an  example  of  the  path  planning  method  is 
depicted.  The  red  dashed  path  is  the  minimum  time  path 
generated  with  input  of  class  (5),  computed  for  the  system 
in  a  zero  wind  field  and  a  moving  target.  The  black  solid  line 
is  the  minimum  time  path  transformed  back  to  the  system  of 
constant  wind  and  fixed  target.  The  dotted  regular  octagon 
segments  represent  the  maximum  rate  right  turns  Ti^a  and 

"^naT 


V.  Designing  the  Tour 

There  are  n  targets,  each  of  whose  reconnaissance  can 
be  satisfied  by  executing  either  of  two  waypoint  pairs.  The 


Fig.  4.  Path  planner  between  two  pairs  of  waypoints 


travel  between  any  two  waypoint  pairs  has  an  associated  cost 
which  is  in  general  asymmetric.  In  this  section,  we  address 
the  coupled  problem  of  choosing  which  camera  to  use  for 
each  target,  and  the  order  in  which  the  targets  should  be 
visited.  For  the  sake  of  clarity,  we  first  address  a  simplified 
version  of  this  problem,  in  which  each  target  has  an  a  priori 
camera  assignment,  and  the  remaining  task  is  to  choose  the 
order  of  the  targets. 

A.  A  priori  camera  choice 

In  this  scenario,  the  reconnaissance  of  each  target  is  satis¬ 
fied  by  the  MAV’s  flight  through  a  single  pair  of  waypoints. 
Each  pair  of  waypoints  has  an  associated  asymmetric  cost 
of  travel  between  them  as  calculated  by  the  path  planner. 
To  gather  intelligence  in  a  timely  manner,  and  save  fuel 
for  future  missions,  we  aim  to  minimize  the  time  elapsed 
throughout  the  tour  of  all  targets.  This  is  clearly  a  realization 
of  the  Asymmetric  Traveling  Salesman  Problem  (ATSP). 

To  solve  the  ATSP,  we  used  a  mixed-integer  linear  pro¬ 
gram  formulation  first  presented  in  [11].  The  following  is  a 
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summary  of  this  method.  Let  di^j  be  the  time  required  to 
fly  the  path  from  the  pair  of  waypoints  associated  to  target 
Ti  to  the  pair  of  waypoints  associated  to  target  Tj  where 
1  <  Minimize: 


n  n 


{i  j) 

(16) 

i=i  j=i 

S.t. 

nn 

II 

(i  ^  j  =  1 , , ,  n) 

(17) 

II 

(i  7^  i  =  1 . . .  n) 

(18) 

i=i 

Vi  -  Vj  +  nxij  <n-l 

(19) 

where  Xij  are  non-negative  integers  and  yi  are  arbitrary  real 
numbers. 

The  constraints  (17)-(18)  require  Xij  to  be  0  or  1,  and 
the  solution  to  the  ATSP  is  interpreted  as  follows:  the  MAV 
flies  from  target  to  target  Tj  if  and  only  if  Xij  =  1. 
The  yi  variables  indicate  the  order  in  which  the  targets  are 
visited.  The  constraints  (19)  serve  to  eliminate  the  possibility 
of  disjoint  sub-tours.  We  refer  the  reader  to  [11]  for  further 
details  of  the  method. 

Since  the  above  formulation  is  a  mixed  integer  linear 
program,  it  is  NP-hard  [7].  Furthermore,  it  is  well  known 
that  there  is  no  efficient  approximation  algorithm  of  the 
ATSP,  unless  P  =NP  [16].  With  the  restriction  that  the 
distances  satisfy  the  triangle  inequality,  there  are  algorithms 
that  achieve  logn  approximations  [4].  The  instance  of  the 
ATSP  that  we  address  can  be  formulated  in  such  a  way 
that  the  distances  satisfy  the  triangle  inequality,  and  the 
possibility  of  using  such  an  approximation  scheme  is  left 
for  future  work. 

B.  General  problem 

The  above  formulation  of  our  tour  design  problem  is 
useful  if  some  desirable  property  of  the  tour  is  produced 
by  following  an  explicit  rule  to  make  the  a  priori  camera 
choices  for  each  target.  However,  consider  the  output  of  such 
an  approach.  It  is  an  ordering  of  the  targets,  along  with  the 
camera  choices  for  each  target,  and  an  associated  cost  of 
the  entire  tour.  If  the  camera  choice  for  a  single  target  was 
changed  from  front  to  left  or  vice  versa,  the  waypoint  pair 
associated  with  this  target  would  change,  and  two  “legs”  of 
the  tour  would  be  altered,  possibly  decreasing  the  length  of 
the  tour  as  a  whole.  Thus  it  is  clear  that  a  minimization  of 
the  tour  time  for  our  problem  is  not  captured  by  an  a  priori 
camera  choice  and  the  ATSP.  However,  there  is  a  variation 
on  the  ATSP  that  does  suffice. 

The  Generalized  Traveling  Salesman  Problem  (GTSP)  [6] 
is  defined  on  a  directed  graph  whose  nodes  are  grouped  into 
m  mutually  exclusive  and  jointly  exhaustive  nodesets.  The 
nodesets  need  not  contain  equal  numbers  of  nodes.  The  arcs 
are  defined  only  between  nodes  of  different  sets,  i.e.,  there 
are  no  intraset  arcs,  and  each  defined  arc  has  an  associated 
non-negative  cost.  The  GTSP  is  the  problem  of  finding  a 


minimum  cost  m-arc  cycle  that  visits  exactly  one  node  from 
each  nodeset. 

For  our  scenario,  the  GTSP  has  n  nodesets  (targets),  each 
of  which  has  a  cardinality  of  two  (each  target  has  two 
available  camera  choices,  i.e.,  waypoint  pairs),  thus  there 
are  2n  nodes  (waypoint  pairs).  We  wish  to  find  the  minimum 
time  trajectory  that  flies  exactly  one  of  the  two  waypoint  pair 
associated  with  each  target. 

To  solve  the  GTSP,  we  implemented  a  GTSP  to  ATSP 
transformation  first  presented  in  [12].  The  method  takes  the 
graph  of  2n  nodes  on  which  the  GTSP  is  defined,  swaps  the 
weights  of  certain  edges,  increases  the  weight  of  all  edges 
by  an  amount  greater  than  the  sum  of  all  edge  weights, 
and  then  adds  certain  zero  weight  intraset  arcs.  The  special 
structuring  of  the  new  graph  is  such  that  the  ATSP  solution 
will  always  visit  all  nodes  within  a  single  cluster  before 
moving  to  another.  Once  this  solution  has  been  obtained, 
[12]  presents  a  method  to  discern  the  optimal  solution  to  the 
associated  GTSP.  This  solution,  of  course,  only  visits  one 
node  per  cluster. 

The  above  method  can  be  used  to  obtain  the  minimum  time 
path  which  satisfies  the  reconnaissance  requirements  of  all 
targets  in  our  problem.  However,  it  requires  the  computation 
of  an  ATSP  with  2n  nodes.  This  is  a  substantial  increase  in 
computational  burden  as  compared  to  the  method  of  making 
a  priori  camera  choices.  Furthermore,  the  distances  in  the 
specially  structured  ATSP  resulting  from  the  transformation 
of  the  GTSP  do  not  satisfy  the  triangle  inequality,  and 
so  there  can  be  no  efficient  approximation  of  the  optimal 
solution.  In  Section  VI  we  explore  the  implementation  and 
performance  of  both  methods  mentioned. 

VI.  Simulations 

This  section  is  devoted  to  analysis  of  simulations.  The 
purpose  of  these  simulations  is  to  test  the  proposed  approach 
on  scenarios  of  practical  interest  for  the  AFRL’s  MAV 
equipment. 

A.  Setup 

The  simulation  test  bed  is  based  on  the 
Multilj4^2simulator  [14].  In  particular,  we  considered 
the  scenario  of  one  MAV,  moving  in  a  wind  field,  on  a 
reconnaissance  mission  with  5  targets  positioned  in  an  area 
of  size  1km  x  1km.  The  desired  cruise  air  speed  was  set 
to  Va  =  24  knots,  and  the  desired  altitude  to  200  feet.  For 
the  path  planner  presented  in  Section  IV,  the  following 
parameters  were  chosen 

-  (T  =  I  rad, 

-  L  =  500ft. 

Although  a  constant  wind  was  assumed  in  the  development 
of  Section  IV,  a  variable  wind  is  included  in  the  simulation 
to  obtain  more  realistic  results.  In  particular,  we  considered 
a  wind  field  with  a  main  component  West-East  of  15  knots 
perturbed  by  additive  variable  wind  gusts  in  all  three  di¬ 
rections  (North,East,Up),  uniformly  spatially  distributed  and 
with  random  magnitudes  and  constant  spatial  extension.  The 
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magnitude  of  the  wind  gusts  was  generated  as  a  zero  mean 
random  variable  with  standard  deviation  of  5  knots. 

The  MAV  model  used  in  the  simulations  presented  is 
based  on  the  Applied  Research  Associates’  Nighthawk,  a 
very  small  (370  grams),  short  endurance  aircraft  powered  by 
a  55  Watt  electric  motor.  It  can  operate  at  air  speeds  of  15-40 
knots  and  at  altitudes  up  to  1,000  feet  mean  sea  level.  The 
airframe  is  a  carbon  fiber  V-tail  with  a  53cm  span  fiexible 
wing  and  a  50cm  fuselage  length.  The  Nighthawk  has  no 
control  surfaces  along  the  wings,  and  its  control  relies  solely 
on  the  V-tail’s  two  rudder/elevators. 

The  Nighthawk  is  equipped  with  a  front  and  a  left  side 
camera.  For  the  purpose  of  this  investigation  the  same 
parameters  have  been  assumed  for  both  of  the  two  cameras: 

-  horizontal  field  of  view  64deg, 

-  vertical  field  of  view  64deg, 

-  depression  angle  -45deg. 

B.  Results 

In  Fig.  5  a  simulation  of  a  5  target  scenario  is  reported. 
In  Fig.  5(a)  the  red  square  is  the  take-off  point.  The  red 
diamonds  and  the  associated  red  solid  lines  represent  the 
targets  and  the  preferred  directions  of  sight.  The  tour  se¬ 
quence  and  the  associated  camera  choice  was  found  as  a 
solution  of  the  GTSP,  using  the  formulation  of  Sec.  V,  after 
the  planner  from  Sec.  IV  computed  the  inter- target  paths 
and  their  associate  costs,  with  the  assumption  of  a  West-East 
constant  wind  of  15  knots.  The  arrows  represent  the  pairs  of 
waypoints  associated  with  each  target,  as  evaluated  in  Sec. 
Ill,  where  dark  (light)  indicates  that  the  front  (left)  camera 
has  been  selected.  The  black  dotted  line  and  the  circles 
represent  the  resulting  path  of  waypoints  associated  with  the 
solution  sequence.  The  solid  blue  line  is  the  actual  ground 
track  as  output  of  Multiy$/2,  while  simulating  the  model  of 
the  Nighthawk  MAV  following  the  waypoint  sequence.  The 
gray  triangles  represent  the  pose  trajectory  sampled  every 
^  40  seconds,  while  the  red  triangles  and  the  associated 
footprints  are  the  poses  of  the  MAV  at  the  snapshot  instants. 

Figure  5(b)  refers  to  three  components  of  the  wind  velocity 
blowing  along  the  actual  trajectory  of  the  vehicle.  In  Fig. 5(c), 
for  each  target,  results  are  presented  in  terms  of  dwell  time 
of  the  target  inside  the  footprint,  target  minimum  distance 
from  the  center  of  the  footprint  and  relative  angular  deviation 
w.r.t.  the  preferred  line  of  sight.  Dark  (light)  bars  stand  for 
the  front  (left)  camera. 

C.  Monte  Carlo  Simulations 

In  order  to  validate  the  proposed  approach,  Monte  Carlo 
simulations  have  been  performed.  Each  run  refers  to  a  5 
target  scenario  similar  to  the  one  proposed  in  the  previous 
subsection,  for  which  randomly  generated  wind  fields,  target 
positions  and  desired  angles  of  view  are  generated.  We 
propose  a  comparison  between  four  different  approaches. 
We  consider  two  possible  path  planners:  the  one  proposed 
in  Section  IV  and  the  discretized  Dubins  path,  currently 
implemented  in  the  Multilj4^2 simulator.  We  consider  two 
tour  design  formulations:  the  GTSP  as  presented  in  Sec.  V, 


(a)  MAV  trajectory 


north 


(b)  Wind 


time 
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target 


(c)  Targets  statistics 
Fig.  5.  Scenario  with  5  targets 

and  a  simpler  ATSP  formulation  where  for  each  target  we 
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TABLE  I 

Methods  used  eor  the  comparison 


problem  formulation 

cost  matrix 

A 

GTSP 

Proposed  Path  Planner 

B 

GTSP 

Dubins  Path  Planner 

As 

TSP 

Proposed  Path  Planner 

Bs 

TSP 

Dubins  Path  Planner 

TABLE  II 

Summarized  average  data  erom  1 00  simulations 


tour  time  (min) 
missed  target 
number  of  waypoints 
time  over  target  (s) 
minimum  distance  (ft) 
angular  deviation  (deg) 
tour  with  missed  targets 
tour  with  missed  targets  >  2 


A 

B 

A, 

Bs 

10.5 

15.3 

11.7 

17.1 

83 

145 

60 

81 

30 

38 

32 

43 

5.54 

5.97 

6.21 

6.4 

27.9 

24.3 

26.4 

23.5 

8.2 

10.2 

8.5 

6.6 

60 

86 

45 

52 

16 

41 

13 
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choose  between  “front”  and  “left”  camera  by  selecting  the 
one  resulting  in  the  slowest  ground  speed  for  that  “viewing 
segment”.  This  choice  was  made  in  agreement  with  the 
intuition  that  a  slower  ground  speed  might  result  in  a  better 
quality  image  taken  by  the  camera.  Table  I  summarizes  the 
different  methods  considered. 

The  output  data  of  each  run,  produced  by  Multil^2,  are 
summarized  in  Table  II  and  Fig. 6.  The  red  solid  lines  and 
symbol  “x”  refer  to  the  results  obtained  for  the  presented 
path  planner  by  solving  the  ATSP  problem  (method  As)’, 
blue  dashed  lines  and  symbol  “o”  refer  to  the  discretized 
Dubins  paths  solving  the  ATSP  (method  Bg)',  red  dash-dot 
lines  and  symbol  “+”  refer  to  the  results  obtained  for  the 
presented  path  planner  by  solving  the  GTSP  (method  A); 
blue  dotted  lines  and  symbol  “o”  refer  to  the  discretized 
Dubins  paths  solving  the  GTSP  (method  B). 

Figure  6(a)  refers  to  the  actual  tour  time  required  to 
complete  the  path.  The  proposed  path  planner  significatively 
reduced  the  average  tour  time  by  about  30%  with  respect  to 
the  Dubins’  planner,  for  both  TSP  and  GTSP  formulations. 
This  aspect  is  particulary  critical  for  the  MAVs  as  they  have 
short  endurance. 

Figure  6(b)  refers  to  the  number  of  waypoints  composing 
the  whole  tour.  Again,  the  proposed  approach  reduces  the  av¬ 
erage  number  of  waypoints  required  to  complete  the  tour  by 
25%  with  respect  the  Dubins  path  planner  for  both  ATSP  and 
GTSP  formulations.  This  aspect  can  be  considered  critical  by 
noticing  that  the  maximum  number  of  waypoints  is  limited 
by  communication  protocol  packet  size  (100  waypoints  for 
the  Nighthawk). 

Finally  in  Fig.  6(c)  the  incremental  evolution  of  missed 
target  along  the  100  runs  is  presented.  A  target  has  been 
considered  missed  if  its  dwell  time  inside  the  footprint  is  less 
than  2  seconds.  In  this  case  the  two  ATSP  formulations  result 
in  better  performance  with  respect  to  GTSP  formulations. 
This  follows  intuition  that  a  slower  ground  speed  reduces  the 
probability  of  missing  a  target.  The  rate  of  missed  targets  has 
been  reduced  from  30%  to  16%  for  the  Dubins  path  planner 
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(b)  Number  of  waypoints 


(c)  Incremental  evolution  of  missed  Targets 
Fig.  6.  Comparison  over  100  runs  for  the  approaches  of  Table  I 


and  from  16%  to  12%  for  the  proposed  path  planner. 

The  average  dwell  time  of  the  targets  inside  footprints 
(Table  II)  is  ^  6s  for  all  the  approaches,  the  average 
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minimum  distance,  of  the  targets  from  the  center  of  the 
footprint,  is  ^  25ft  and  the  average  angular  deviation  is 
^  lOdeg. 

Several  aspects  have  been  investigated  in  this  simulation 
analysis.  From  the  tour  time  data  we  conclude  that  different 
path  planning  methods  which  explicitly  take  the  wind  into 
account  should  be  considered  in  order  to  significatively  re¬ 
duce  the  fuel  consumption  and  the  number  of  tour  waypoints 
needed.  Moreover  the  missing  targets  data  show  that  the 
camera  choice  associated  with  the  slower  ground  speed  can 
significatively  reduce  the  probability  of  missing  a  target, 
hence  the  ATSP  formulation  is  preferred  with  respect  to 
the  GTSP  in  that  respect.  Finally  one  should  notice  that 
although  method  Bs  showed  a  degradation  of  the  tour  time 
with  respect  to  method  B  of  about  10%,  this  value  could  be 
easily  compensated  by  the  possible  mission  requirements  of 
a  second  tour  in  the  case  of  missed  target. 

VII.  Conclusions 

This  paper  deals  with  a  reconnaissance  problem  for  an 
MAV  fiying  in  a  constant  wind  field,  using  fixed  onboard 
cameras  to  take  video  footage  of  a  set  of  targets  with  known 
positions  and  desired  viewing  angles.  The  MAV  is  assumed 
to  be  equipped  with  an  autopilot  capable  of  performing 
path  following  of  a  waypoint  sequence.  The  challenge  is  to 
generate  a  waypoint  path  that  explicitly  takes  the  wind  and 
the  autopilot  path  following  module  into  account,  so  that  the 
camera  footprint  is  more  likely  to  pass  over  each  target  in 
spite  of  the  wind. 

First  we  address  the  problem  of  placing  a  pair  of  waypoints 
such  that,  if  fiown  by  the  MAV,  the  camera  footprint  passes 
over  the  target.  Next,  we  introduce  a  waypoint  path  planner 
that  chooses  minimum  time  paths  joining  two  given  pairs  of 
waypoints,  among  a  restricted  path  family  which  takes  the 
wind  and  the  MAV’s  behavior  into  account.  We  then  identify 
the  problem  of  minimizing  the  duration  of  the  tour  viewing 
all  targets,  where  each  target  may  be  viewed  by  one  among 
several  cameras,  as  a  realization  of  the  GTSP.  Extensive 
simulations  in  the  presence  of  randomly  perturbed  wind  have 
been  provided,  along  with  a  comparison  among  different 
approaches.  In  particular,  the  path  planner  proposed  here  has 
been  compared  with  a  discretized  Dubins  path  planner,  previ¬ 
ously  implemented  in  Multilj4^2,  and  the  GTSP  formulation 
has  been  compared  to  an  ATSP  formulation  where  between 
the  two  cameras  available  for  the  MAV  we  choose  the  one 
resulting  in  the  slowest  ground  speed.  All  the  simulations 
use  a  model  of  the  Nighthawk  MAV,  a  component  of  the 
AFRL  equipment.  The  analysis  and  study  conducted  in  this 
work  have  shown  that  path  planners  which  explicitly  take 
the  wind  into  account  result  in  a  significant  reduction  in  fuel 
consumption  and  a  lowered  probability  of  missing  targets. 

Future  research  may  involve  the  implementation  and  test¬ 
ing  of  this  method  on  the  real  Nighthawk  MAV  testbed. 
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